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REMARKS 

In view of the above amendments and the following remarks, reconsideration of 
the rejections and further examination are respectfully requested. 

The specification and abstract have been reviewed and revised to improve their 
English grammar. The amendments to the specification and abstract have been 
incorporated into a substitute specification and abstract. Attached are two versions of the 
substitute specification and abstract, a marked-up version showing the revisions, as well 
as a clean version. No new matter has been added. 

Original claims 4 and 8 have been cancelled without prejudice or disclaimer to the 
subject matter contained therein. Claims 1 and 5 have been amended to include the 
subject matter of cancelled claims 4 and 8, respectively. Claims 9-1 1 have been added to 
recite subject matter similar to that recited in claim 1 using structural language, rather 
than "means" language. In addition, claims 1-3 and 5-7 have been amended so as to 
make a number of editorial revisions thereto. 

Claims 1 and 5 were rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Kodak DC240/DC280 in view of Park (US 5,231,440). Further, claims 2, 3, 6, and 7 
were rejected under 35 U.S.C. § 103(a) as being unpatentable over Kodak in view of Park 
and further in view of Imaizumi et al. (US 6,236,389). Claims 4 and 8 were rejected 
under 103(a) as being unpatentable over Kodak in view of Park and further in view of 
Takahashi (US 2003/133084). 

The above-mentioned rejections are believed clearly inapplicable to amended 
claims 1-3 and 5-7 and new claims 9-1 1 for the following reasons. 

Generally, the invention of claims 1-3, 5-7, and 9-11, discussed below, relates to 
image enlargement of a photographed image using both image cropping (i.e., trimming 
away part of the original picture such that only a defined portion of the original image 
remains) and image compression , of the same photographed image, for viewing on a 
television having a lower line count than the photographed image. Specifically, the 
image to be enlarged for viewing on the television is selected from either the cro pped 
image or the compressed image based on a user's selection. It is noted that compression 
of the photographed image takes longer than cropping of the image and also reduces 
image quality when compared to cropping. 
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For example, compression to a lower line count of a television is more processor 
intensive than simply cropping a portion of an image and displaying the cropped portion 
on a television, because compression requires a reduction of a line count of the entire 
image and a reproduction of the entire image with a reduced line count, and cropping 
only requires selecting an appropriate portion of the image to be cropped (i.e., removed 
from the original image). In view of the above, this invention can reduce the amount of 
time required to view an enlarged image by providing an option to display a cropped 
enlarged image or a compressed enlarged image. The specifics and the distinguishing 
features of the claimed invention are discussed in detail below. 

Amended Claims 1-3 are Patentable Over the Prior Art of Record 

Amended independent claim 1 recites an image enlarging apparatus including, in 
part (1) an imaging means for outputting a photographed image, wherein a vertical and a 
horizontal line count of the photographed image are greater than a vertical and horizontal 
line count of a television format, (2) an image cropping means for receiving the 
photographed image, for cropping the photographed image, and for generating a cropped 
image having a vertical and horizontal line count matching the vertical and horizontal 
line count of the television format, (3) an image compression processing means for 
receiving the photographed image, for compressing the photographed image such that the 
vertical and horizontal line count of the photographed image match the vertical and 
horizontal line count of the television format, and for generating a compressed image . (4) 
a switching means for selecting the cropped image or the compressed image, and (5) an 
enlargement processing means for enlarging the selected image. 

In other words, the image enlarging apparatus of independent claim 1 includes an 
image cropping means and an image compression processing means arranged to crop and 
compress, respectively, the photographed image, wherein a switching means allows a 
selection of either the cropped or compressed image to be enlarged by an enlarging 
means. 

The Kodak, Park, Takahashi, and Imaizumi references, or any combination 
thereof, fail to disclose or suggest the image cropping means, the image compression 
processing means, and the switching means as recited in independent claim 1 . 



Rather, the Kodak reference teaches a digital zoom camera that can take pictures 
having a resolution up to 2.3 million pixels (1901 pixels x 1212 pixels), being a 
resolution which is higher than a standard TV format. Further, Kodak discloses that the 
digital camera has a video output for connecting to a TV and can convert the images 
taken at 2.3 million pixels to a standard TV format. However, Kodak does not disclose 
or suggest as recognized by the Examiner on page 3 of the Office Action, the image 
cropping means, the image compression processing means, or the switching means as 
recited in claim 1 . 

In light of the deficiencies of the Kodak reference, the rejection relies on the Park 
reference for teaching the cropping feature of independent claim 1 . However, the Park 
reference fails to disclose or suggest the separate and distinct cropping and compression, 
and the switching, as recited in independent claim 1. 

Rather, the Park reference teaches an apparatus for converting an aspect ratio and 
a number of scanning lines of a video signal. Specifically, the Park reference teaches an 
apparatus for converting a received HDTV video signal into a standard (NTSC) video 
signal (see abstract, and Fig. 1). Further, Park teaches inputting a HDTV signal (see col. 
4, lines 1-4) and then converting every line of the HDTV signal into a standard (NTSC) 
TV signal (see col. 4, lines 64-67). Moreover, it is noted that the entire video signal is 
converted (i.e., every line is considered) in order to output the NTSC video signal (see 
col. 6, lines 28-32). 

In the context of image manipulation, Park teaches downgrading the resolution of 
an entire HDTV signal by removing various lines of resolution so that the HDTV signal 
can be represented at a lower resolution and displayed on a NTSC TV. However, Park 
does not disclose or suggest the image cropping means and the image compression 
processing means arranged to cro p a portion of the photographed image and separately 
compress the entire photographed image. In other words, converting an entire HDTV 
signal is not the same as or even similar to separately cropping and compressing the same 
photographed image such that, based on the cropping, only a portion of the photographed 
image is available, and, based on the compressing, the entire portion of the photographed 
image is available. Accordingly, it is clear that Park fails to address the deficiencies of 
Kodak which are recited in amended independent claim 1 . 



Further, light of the deficiencies of the Kodak and Park references, the rejection 
relies on the Takahashi reference for teaching the compression and switching features of 
independent claim 1 . However, the Takahashi reference fails to address the deficiencies 
of the Kodak and Park references, which are the separate and distinct cropping and 
compression, and the switching, as recited in independent claim 1 . 

Rather, the Takahashi reference teaches an image recording device with a 
structure for adjusting the device based on a video signal Specifically, as noted by the 
Examiner, the Takahashi reference teaches compression of a video signal by a 
compression circuit 29 capable of switching outputs based on compression mode 1 and 
compression mode 2 (see Fig. 1). 

In the context of signal manipulation, the Takahashi reference teaches 
compression of a video signal and switching/selecting an output based on a 
selected/desired compression mode. However, Takahashi does not disclose or suggest 
the separate and distinct cropping and compression, and switching, as discussed above, 
since selecting between two compressed video signals is not the same as or even similar 
to separately cropping and compressing the same photographed image, such that, based 
on the cropping, only a portion of the photographed image is available, and, based on the 
compressing, the entire portion of the photographed image is available. Accordingly, it is 
clear that Takahashi fails to address the deficiencies of Kodak and Park which are recited 
in amended independent claim 1. 

Additionally, the Imaizumi reference was relied on in the rejection for teaching 
the limitations of claims 2-3 which are not disclosed in the Kodak reference. However, it 
is respectfully submitted that the Imaizumi reference does not disclose or suggest any of 
the above-discussed features of independent claim 1 which are lacking from the Kodak, 
Park, and Takahashi references. Accordingly, it is clear that Imaizumi fails to address the 
deficiencies of Kodak, Park, and Takahasi which are recited in amended independent 
claim 1 . 

Furthermore, please note that one of the benefits of the configuration recited in 
independent claim 1 is that the operator of the image enlarging apparatus always has the 
option of enlarging the photographed image by way of normal zooming (i.e., image 
compression by the image compression processing means) or by way of instantaneous 



zooming (i.e., image cropping by the image cropping means), since the original 
photographed image is cropped and compressed separately. 

It is noted that the above-mentioned benefit of claim 1 is absent from the 
combination of the Kodak, Park, Takahashi, and Imaizumi references. 

In view of the above, it is respectfully submitted that the Kodak, Park, Takahashi, 
and Imaizumi references do not anticipate the invention as recited in amended 
independent claim 1 or the claims that depend therefrom. Furthermore, the Kodak, Park, 
Takahashi, and Imaizumi references do not suggest the above-discussed limitations of 
claim 1 or the claims that depend therefrom. Therefore, it would not have been obvious 
to one of ordinary skill in the art to modify the Kodak, Park, Takahashi, and Imaizumi 
references so as to obtain the invention of amended claim 1 . Accordingly, it is 
respectfully submitted that amended independent claim 1 and the claims that depend 
therefrom are clearly allowable over Kodak, Park, Takahashi, and Imaizumi. 

Amended Claims 5-7 and New Claims 9-11 are Patentable Over the Prior Art of 
Record 

Amended independent claim 5 and new independent claim 9 recite an image 
enlarging method and an image enlarging apparatus, respectively, wherein the method 
and apparatus operate in a similar manner as the apparatus recited in amended 
independent claim 1. Accordingly, claims 5-7 and 9-1 1 each include at least one 
limitation that is similar to one of the distinguishing limitations of claim 1 discussed 
above. Thus, for reasons similar to those discussed above, it is respectfully submitted 
that claims 5-7 and 9-1 1 are allowable over the Kodak, Park, Takahashi, and Imaizumi 
references. 
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In view of the above amendments and remarks, it is submitted that the present 
application is now in condition for allowance and an early notification thereof is earnestly 
requested. The Examiner is invited to contact the undersigned by telephone to resolve 
any remaining issues. 



Respectfully submitted, 
Toshiro MIYAZAKI 



By: 




Registration No. 60,554 
Attorney for Applicant 

DMO/ALD/nrj 

Washington, D.C. 20006-1021 
Telephone (202) 721-8200 
Facsimile (202) 721-8250 
June 27, 2007 
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SPECIFICATION 

TITLE OF THE INVENTION 

Image enlarging apparatus and method 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image 
enlarging apparatus and an image enlarging method that can 
immediately produce a digital image zooming effect with 
little image degradation. 

2. Description of the Related Art 

Three of the most desirable features on the 
latest video cameras are a digital zoom function, high 
image quality, and easy operation. A conventional image 
enlarging system such as that used in video cameras to 
provide a digital zoom function is described below. 

Conventionally, a digital zoom effect is 
achieved with — using a digital signal processing zoom 
circuit. The configuration of a conventional image zooming 
system is described below with reference to the block 
diagram thereof shown in Fig. 8. 

Referring to Fig. 8, the lens unit 201 includes 
a zoom lens 201b for optically enlarging and reducing 
images, and a zoom motor 201a for moving the zoom lens 
201b along the optical axis of the lens. The CCD 202 is a 
charge-coupled device for imaging an incident — optical 
signal e£ — incident to the subject and converting the 
optical signal to an electrical image signal. The analog 
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signal processor 203 then boosts the output level of the 
image signal from the CCD 202. The A/D converter 204 is an 
analog/digital converter for converting the analog image 
signal output from the analog signal processor 203 to a 
digital signal. 

The image quality processing circuit 205 of the 
digital signal processor 200 then applies gamma correction, 
aperture correction, or other image processing operations 
to the image signal from the A/D converter 204. The 
vertical image signal processing circuit 206 then 
processes the image from the image quality processing 
circuit 205 in — a vertical scanning direction to 
compress ^feh-e — a vertical line count of the image signal 
coming from the image quality processing circuit 205 
according to fcfee — a vertical line count of a particular 
television format. The horizontal image signal processing 
circuit 207 horizontally processes the image coming from 
the vertical image signal processing circuit 206 to 
compress the — a horizontal line count ( i.e., horizontal 
pixel count) of the image signal coming from the vertical 
image signal processing circuit 206 according to ^fefee — a 
horizontal resolution of the particular television format. 

The image size adjusting circuit 210 is the 
digital zooming circuit for electronically enlarging or 
reducing the image signal from the horizontal image signal 
processing circuit 207 to a desirable image size. The 
microprocessor 214 is the control means for controlling 
the circuits of the digital signal processor 200. The zoom 



switch 215 is equivalent to the zoom lever or zoom button 
of a typical video camera. The zoom switch 215 can be used 
for continuous optical and digital zooming. 

The zoom motor control signal processor 212 
outputs control signals for controlling the zoom direction 
and amountT — that io, (i.e., the direction and distance of 
zoom lens movement 7 — ) as instructed by the microprocessor 
214 to the zoom lens drive circuit 213. The zoom lens 
drive circuit 213 drives the zoom motor 201a of the lens 
10 unit 201 based on the control signals from the zoom motor 
control signal processor 212. The CCD drive circuit 211 
likewise drives the CCD 202 as controlled by the 
microprocessor 214. 

What happens when the zoom switch 215 is 
15 operated is described next with reference to Fig. 2 (a) . 

Referring to Fig. 2 (a) , first image area 31a is 
captured by the CCD 2 02 and output from image quality 
processing circuit 205. The vertical line count in this 
example is 720 horizontal lines. Subject image 33a is 
20 formed in first image area 31a. The second image area 32a 
compresses the number of lines in the vertical and 
horizontal directions so that the image formed in the 
first image area 31a matches a particular television 
format. Images in the second image area 32a are thus 
25 compressed to a vertical line count of 480 horizontal 
lines in this example. Cropping area 3 6a is the image area 
presented on the second image area 32a . when the zoom 
switch 215 is operated to enlarge the subject. As the 
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magnification ratio of the zoom lens increases, the number 
of vertical and horizontal lines in the second] cropping 
area 36a decreases. For example, if the digital zoom ratio 
is 1.5X, the zoomed image contains image information from 
a 320-line area of the original image. The output image 
area 35a is the image from seco|nd cropping area 3 6a 
converted to an image with a vertical line count of 480 
lines for presentation. 

Operation of the conventional zooming system 
configured as above is described below. Operation during 
normal recording, that is, when not zooming, is described 
first . 

The optical signal of the subject incident on 
the CCD 202 through the . lens groups of the lens unit 201 
is converted to an electrical image signal and output to 
the analog signal processor 203. The signal level from the 
CCD 202 is low, and the analog signal processor 203 
therefore applies a signal level amplification process to 
boost the signal, which is then A/D converted by the A/D 
converter 204 from the analog signal to a digital signal . 
The output signal from the A/D converter 204 is input to 
the image quality processing circuit 205, which applies 
gamma correction, aperture correction, or other signal 
processing, resulting in an image such as shown in first 
image area 31a in Fig. 2 (a) being input to the vertical 
image signal processing circuit 206. 

The vertical image signal processing circuit 206 
compresses the vertical line count of the image shown in 



the first image area 31a in Fig. 2 (a) to match the 
effective vertical line count of the television format. 
Because the vertical line count of an image from the image 
quality processing circuit 205 is 720 in this example, 
this line count compression process reduces the line count 
to 2/3 or 480 lines. The vertical image signal processing 
circuit 206 outputs the compressed image to the horizontal 
image signal processing circuit 207 , which compresses the 
horizontal resolution according to the vertical 
compression as described above. The image resulting from 
this process is shown in second image area 32a in Fig. 2 
(a) . By thus compressing the line count of the image, it 
is possible to reduce only the size while keeping the same 
view angle as the image from the CCD 202. 

The image signal from the horizontal image 
signal processing circuit 207 is then passed through the 
image size adjusting circuit 210 and output from the 
output terminal. A digital signal compression circuit 
display means then image — comprcoococompr esses the image 
signal output from the image size adjusting circuit 210, 
and then outputs the compressed image signal to a display 
means ( e.g., an^ke LCD or electronic viewfinder of a video 
camera 7 — — example ) or recording means ( e.g., a device 
for recording the signal to tape, disc, or other recording 
medium) . 

It should be noted that if a zoom operation 
controlled by the zoom switch 215 is not executed by the 
image size adjusting circuit 210 as in this example, the 
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signal is output directly from the horizontal image signal 
processing circuit 207. 

Operation when the zoom switch 215 is operated 
is described next. 
5 When the user operates the zoom switch 215, the 

microprocessor 214 controls the zoom lens drive circuit 
213 to determine the current zoom ratio of the optical 
zoom lens. If the zoom ratio is from IX to 10X, the 
microprocessor 214 controls the zoom motor control signal 

10 processor 212 so that the input image is enlarged or 
reduced. This command causes the zoom motor control signal 
processor 212 to generate a control signal for driving the 
zoom lens 201b based on how the zoom switch 215 is 
operated, that is, whether to zoom to telephoto or wide 

15 angle, and how far. The resulting control signal is output 
to the zoom lens drive circuit 213. The zoom lens drive 
circuit 213 controls the zoom motor 201a based on this 
control signal, and thereby moves the zoom lens 2 01b along 
the optical axis. The zooming direction and distance are 

20 determined by the control signal generated by the zoom 
motor control signal processor 212. 

The zoom lens 201b thus moves to the controlled 
position, the CCD 202 converts the optical signal to an 
electrical signal, and outputs this electrical signal to 

25 the analog signal processor 203 as an image signal. The 
analog signal processor 203 boosts the image signal level 
and outputs the boosted image signal to the A/D converter 
204 for analog/digital signal conversion. The resulting 
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digital image signal is then corrected by gamma correction 
or aperture correction, for example, by the image quality 
processing circuit 205, and the vertical and horizontal 
resolution are then compressed by the vertical image 
5 signal processing circuit 206 and horizontal image signal 
processing circuit 207 to match the line count of the 
specified television signal format. The compressed image 
signal is then output through the image size adjusting 
circuit 210. 

10 With optical zooming, the image enlarged or 

reduced by the zoom lens 2 01b is input to the image 
quality processing circuit 205 as the image shown in first 
image area 31a in Fig. 2 (a) . The image signal ultimately 
output from the output terminal is therefore the image as 

15 shown in second image area 32a. 

If the zoom ratio is 10X or greater, however, 
the optical zoom is in the far telephoto position and 
digital zooming is therefore applied. In this case the 
microprocessor 214 instructs the image size adjusting 

20 circuit 210 to enlarge or reduce the input image signal 
accordingly. The image signal shown in second image area 
32a in Fig. 2 (a) is input to the image size adjusting 
circuit 210, and the middle part of this image signal (the 
cropping area 36a) is extracted and digitally enlarged to 

25 the zoom ratio specified by the zoom switch 215. An image 
signal enlarged 1.5X, for example, is acquired by 
extracting a 320-line section from the middle of the 
second image area 32a containing 480 horizontal lines, and 
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then digitally converting this 320-line section to a 480- 
line image. 

This method is taught in Japanese Unexamined 
Patent Appl . Application Publication Pub. H06-350892. 

BRIEF SUMMARY OF THE INVENTION 
With the conventional configuration described 
above the vertical image signal processing circuit 206 and 
horizontal image signal processing circuit 207 compress 
the vertical and horizontal line counts of the image, and 
the compressed image is then enlarged by the image size 
adjusting circuit 210. This enlarging process degrades the 
image resolution (particularly the vertical resolution) , 
and thus reduces overall image quality. 

The present invention is directed to solving 
this problem, and an object of the invention is to provide 
an image enlarging apparatus and method providing an 
instantaneous image enlargement function with little image 
degradation. 

To achieve this object, an image enlarging 
apparatus according to the present invention has a charge- 
coupled device for converting an optical signal of a 
subject to an electrical image, a signal processing means 
for compressing the line counts of images from the CCD to 
the line counts of a particular television format, a user- 
operable selection means, and a control means for 
controlling the signal processing means based on how the 
selection means is operated. When the selection means is 
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operated, the control means instructs the signal 
processing means to skip the image compression process and 
crop the image from the CCD to an image of the line count 
matching the television format. 

Thus comprised, the image enlarging apparatus 
and method of this invention provides an instantaneous 
image zooming effect with little image quality degradation 

Other objects and attainments together with a 
fuller understanding of the invention will become apparent 
and appreciated by referring to the following description 
and claims taken in conjunction with the accompanying 
drawings . 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE 
DRAWING FIGURES 

Fig. 1 is a block diagram ohowing — illustrating 
the configuration of an image enlarging apparatus 
according to a first embodiment of the present invention; 

Figs. 2 — (a) and 2(b) are schematic diagrams 
illustrating the image zooming concept of first and second 
zoom functions; 

Fig. 3 is a graph ohowing — illustrating the 
relationship between zoom ratio and image size in this the 
first embodiment of the invention; 

Fig. 4 is a graph showing — illustrating the 
relationship between image size and resolution in this the 
first embodiment of the invention; 

Fig. 5 is a graph ohowing illustrating 
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application of the cropping area of the image trimming 
circuit in this the first embodiment of the invention; 

Fig. 6 is a block diagram il lust rat ing ohowing 
the image trimming circuit in detail; 

Fig. 7 is a schematic diagram describing the 
operation of the image trimming circuit; and 

Fig. 8 is a block diagram il lust rat ing ohowing 
the configuration of a conventional image enlarging 
apparatus . 

DETAILED DESCRIPTION OF THE INVENTION 
The present invention as described in claim 1 
below has a charge-coupled device (CCD) for converting an 
optical signal of a subject image to an electrical image 
signal, a signal processing means for compressing the line 
counts of images coming from the CCD to ^he — equivalent 
effective line counts of a particular television format, a 
user-operable selection means, and a control means for 
controlling the signal processing means based on the 
operation of the selection means. When the selection means 
is operated, the control means instructs the signal 
processing means to skip the image compression process of 
the signal processing means, as described above, and to 
crop the image coming from the CCD to an image o^ — having 
the line count matching the television format. The 
apparatus and method of the present invention therefore 
provides an immediate digital image zooming effect with 
little image quality degradation since the image 
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compression process is bypassed . 

A preferred embodiment of the invention thus 
comprised is described next — below with reference to the 
accompanying figures . 
5 * First embodiment 

Fig. 1 is a block diagram illustrating ohowing 
the configuration of an image enlarging apparatus 
according to a preferred embodiment of the invention. 
Referring to Fig. 1, the lens unit 101 has a zoom lens 

10 101b for optically enlarging or reducing a subject image, 
and a zoom motor 101a for moving the zoom lens 101b along 
the optical axis of the lens. The CCD 102 images and 
| converts the incident — optical signal e-f — incident to the 
subject to an electrical image signal. The analog signal 

15 processor 103 then boosts the output signal level of the 
image signal from the CCD 102. The A/D converter 104 then 
analog /digital converts the analog image signal from the 
analog signal processor 103 to a digital signal, and thus 
supplies a digital image signal to the digital signal 

20 processor (DSP) 100. 

The image quality processor 105 of the DSP 100 
applies gamma correction, aperture correction, or other 
correction processes to the image signal from the A/D 
converter 104. The vertical image signal processing 

25 circuit 106 applies signal processing in the vertical 
direction of the image from the image quality processor 
105, and more specifically compresses the vertical line 
count of the image signal from the image quality processor 
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105 according to the vertical line count of a particular 
television format. The horizontal image signal processing 
circuit 107 applies signal processing in the horizontal 
direction to the image from the vertical image signal 
5 processing circuit 106, and more particularly compresses 
the horizontal line (pixel) count of the image signal from 
the vertical image signal processing circuit 106 according 
to the horizontal line count of the television format. 
Note that the vertical and horizontal image signal 

10 processing circuits 106 and 107 constitute the signal 
processing means of the accompanying claims. The image 
trimming circuit 108 crops the image signal from the image 
quality processor 105 to a center part of the image. 

Selector switch 109 then selects and passes to 

15 the image sizing circuit 110 signal output from the 
horizontal image signal processing circuit 107 or from the 
image trimming circuit 108. The image sizing circuit 110 
then digitally enlarges or reduces the image signal from 
the horizontal image signal processing circuit 107 or 

20 image trimming circuit 108, and outputs the resized image. 
The image sizing circuit 110 is thus a so-called digital 
zoom circuit. 

A microprocessor 114 is a control means for 
controlling the circuits of the DSP 100. A first zoom 

25 switch 115 is equivalent to the zoom lever or button of a 
normal video camera, and is used for continuous zooming 
through the entire optical and digital zooming range. The 
function for enlarging an image as a result of operating 
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this first zoom switch 115 is referred to herein as a 
first enlarging function. The second zoom switch 116 is a 
selection means that can be operated to immediately 
acquire an enlarged image. In this embodiment of the 
5 invention the image presented by operating the second zoom 
switch 116 is magnified 1 . 5X from the image observed 
before the second zoom switch 116 is operated. The 
enlarging function that is operated using this second zoom 
switch 116 is referred to herein as the second enlarging 

10 function (or instantaneous zoom function) . The operating 
unit 117 is used to control the part of the image that is 
cropped by the image trimming circuit 108 and presented. 

The zoom motor control signal processor 112 of 
the DSP 100 is controlled by the microprocessor 114 and 

15 outputs control signals telling the zoom lens drive 
circuit 113 the direction and distance to move the zoom 
lens. The zoom lens drive circuit 113 drives the zoom 
motor 101a of the lens unit 101 based on control signals 
from the zoom motor control signal processor 112, and the 

20 CCD drive circuit 111 drives the CCD 102 as controlled by 
the microprocessor 114. 

The image quality processor 105, vertical image 
signal processing circuit 106, horizontal image signal 
processing circuit 107, image trimming circuit 108, 

25 selector switch 109, image sizing circuit 110, and zoom 
motor control signal processor 112 form a DSP 100, which 
can be built in a single chip. 

Fig. 2 schematically describes the operating 
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principle of an image enlarging apparatus, (a) describing 
operation when the first zoom switch 115 is operated, and 
(b) describing operation when the second zoom switch 116 
is operated . 

5 In Fig. 2 the first image areas 31a and 31b 

denote represent the image area captured by the CCD 102 
and output from the image quality processor 105, and thus 
represent the raw photographed image. The vertical and 
horizontal line counts of this photographed image are 

10 greater than the vertical and horizontal line counts of 
the television format. 

The vertical line count as used herein is the 
number of horizontal lines counted in the vertical 
direction of the image, and thus denotes the vertical 

15 resolution of the image. The horizontal line count is the 
number of pixels on each horizontal line, and thus denotes 
the horizontal resolution of the image. In this preferred 
embodiment of the invention there are 720 scan lines in 
the vertical direction of the captured image, and the 

20 vertical line count of the television format is 480. The 
line count in the horizontal direction, that is, the 
number of pixels on each horizontal line, is 971 in the 
captured image and 720 in the television format. 

It will be obvious that the present invention is 

25 being described with reference to the NTSC television 
format by way of example only, and the invention can also 
be applied to the PAL format, for example. 

Subject images 33a and 33b are formed in first 



14 



image areas 31a and 31b. The second image area 32a 
represents a compressed image acquired by compressing the 
number of lines in the vertical and horizontal directions 
so that the image formed in the first image area 31a 
5 matches a particular television format. Second image area 
32b represents a cropped image acquired by trimming the 
photographed image in first image area 31b to the vertical 
and horizontal line counts of the television format. 

The cropping area 34 is the area extracted from 

10 the middle of the photographed image when the second zoom 
switch 116 is operated. The vertical line count of this 
cropping area 34 is 480 lines in order to match the 
vertical line count of the television format. 

Cropping area 36a is the area of the second 

15 image area 32a that is extracted when the first zoom 
switch 115 is operated, and cropping area 36b is the area 
of the second image area 32b that is extracted when the 
second zoom switch 116 is operated. The higher the digital 
zoom ratio, the lower the vertical and horizontal line 

20 counts of second cropping areas 36a and 36b. If the 
digital zoom is set to 1.5X, for example, the extracted 
image area is 320 lines high. Output image areas 35a and 
35b contain the images from the second cropping areas 36a 
and 36b converted to a 480 vertical line count for 

25 presentation. 

It should be noted that while only processing in 
the vertical direction is described above, the images are 
similarly processed in the horizontal direction. 

15 



When the first zoom switch 115 is operated, the 
microprocessor 114 activates the image quality processor 
105, the vertical image signal processing circuit 106, the 
horizontal image signal processing circuit 107, and the 
image sizing circuit 110, and also sets the selector 
switch 109 to side b. When the second zoom switch 116 is 
operated, the microprocessor 114 activates the image 
quality processor 105, the image trimming circuit 108, and 
the image sizing circuit 110, and also sets the selector 
10 switch 109 to side a. If both first zoom switch 115 and 
second zoom switch 116 are operated simultaneously, the 
second zoom switch 116 is ignored and operation continues 
as though the first zoom switch 115 was operated. 

Operation during normal photography not using 
15 the zoom function is described first. 

The optical image of the subject incident on the 
CCD 102 through the lens groups of the lens unit 101 is 
converted to an electrical image signal, which is output 
to the analog signal processor 103. The signal level of 
20 the CCD 102 output is low, and the analog signal processor 

103 therefore boosts the signal level before conversion 
from an analog signal to a digital signal by the A/D 
converter 104. The output signal from the A/D converter 

104 is input to the image quality processor 105, which 
25 applies gamma correction, aperture correction, or other 

signal processing operation, and the image shown in the 
first image area 31a in Fig. 2 (a) is thus input to the 
vertical image signal processing circuit 106. 
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The vertical image signal processing circuit 106 
then compresses the vertical line count of the image shown 
in first image area 31a in Fig. 2 (a) to a line count 
matching the equivalent effective vertical line count of 
the television format. Because the vertical line count of 
images from the image quality processor 105 is 720 in this 
embodiment, this line count is compressed to 2/3 or 480 
lines . 

The image output from the vertical image signal 
processing circuit 106 is then input to the horizontal 
image signal processing circuit 107 for compressing the 
horizontal line count according to the vertical 
compression. The image at this time is as shown in the 
second image area 32a. By thus compressing the line counts 
of the image, the view angle of the image from the CCD 102 
remains unchanged while the size of the image is reduced. 

The image signal from the horizontal image 
signal processing circuit 107 is then output through the 
selector switch 109 and image sizing circuit 110 and the 
output terminal. A digital signal compression circuit 
display means then image — comproooco compresses the output 
image signal, and then outputs the compressed image signal 
to a display means ( e.g., the LCD or electronic viewfinder 
of a video camera 7 — for example )' or recording means ( e.g. , 
a device for recording the signal to tape, disc, or other 
recording medium) . 

It should be noted that if a zoom operation 
controlled by the first zoom switch 115 is not executed by 
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the image size adjusting circuit 110 as in this example, 
the signal is output directly from the horizontal image 
signal processing circuit 107. 

The zoom operation is described next. 

Fig. 3 is a graph illustrating ohowing the 
relationship between zoom ratio and output image size. 
Curve A represents performance when the first enlarging 
function is operated without using the second enlarging 
function, and curve B represents performance when the 
first enlarging function is operated when the second 
enlarging function is also used. These curves assume a 
zoom system featuring a 10X optical zoom and a 20X or 
higher digital zoom. The optical zoom is used for image 
enlargement from IX to 10X, and the digital zoom is used 
for image enlargement at zoom ratios exceeding 10X. As 
shown in the figure, the output image size increases as 
the zoom ratio increases. 

Fig. 4 is a graph illustrating ohowing the 
relationship between zoom ratio and vertical resolution. 
Curve A represents performance when the first enlarging 
function is operated without using the second enlarging 
function, and curve B represents performance when the 
first enlarging function is operated when the second 
enlarging function is also used. As shown in the figure, 
there is no drop in the vertical resolution on either 
curve A or B in the optical zoom range, that is, when the 
zoom ratio is from IX to 10X. However, when the zoom ratio 
exceeds 10X, that is, enters the digital zoom range, the 
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vertical resolution drops on curve A when the zoom ratio 
surpasses 10X. 

Operation when only the first zoom switch 115 is 
used is described next. 
5 When the user operates the first zoom switch 115, 

the microprocessor 114 controls the zoom lens drive 
circuit 113 and acquires the current optical zoom ratio. 
If the zoom ratio is from IX to 10X, the microprocessor 
114 instructs the zoom motor control signal processor 112 

10 so that the input image is enlarged or reduced accordingly. 
This command causes the zoom motor control signal 
processor 112 to generate a control signal for driving the 
zoom lens 101b based on first zoom switch 115 operation, 
that is, how far to zoom and whether to zoom in the 

15 telephoto or wide-angle direction. The resulting control 
signal is applied to the zoom lens drive circuit 113, 
which drives the zoom motor 101a based on this control 
signal and moves the zoom lens 101b along the optical axis 
of the lens. The zoom direction and distance are 

20 determined by the control signal generated by the zoom 
motor control signal processor 112. 

When the zoom lens 101b moves to the specified 
position, the CCD 102 converts the optical signal to an 
electrical signal, and outputs the electrical image signal 

25 to the analog signal processor 103. The analog signal 
processor 103 boosts the signal level of the analog image 
signal and then outputs the analog image signal to the A/D 
converter 104 for conversion to a digital signal. The 
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resulting digital image signal is then processed by the 
image quality processor 105 for gamma correction or 
aperture correction, for example, and the vertical and 
horizontal line counts of the corrected image signal are 
5 then compressed by the vertical and horizontal image 
signal processing circuits 106 and 107 to match the line 
counts of the particular television signal format. The 
compressed image signal is then output through the 
selector switch 109 and image sizing circuit 110. 

10 When using the optical zoom, the image enlarged 

or reduced by the zoom lens 101b is input to the image 
quality processor 105 as the image shown in first image 
area 31a in Fig. 2 (a), and the image signal ultimately 
output from the output terminal is the image shown in 

15 second image area 32a. 

When the zoom ratio exceeds 10X, however, the 
optical zoom is set to the maximum telephoto position and 
digital zooming is therefore needed. In this case the 
microprocessor 114 controls the image sizing circuit 110 

20 to enlarge or reduce the input image signal. The image 
signal shown in second image area 32a in Fig. 2 (a) is 
input to the image sizing circuit 110, which then extracts 
the middle part (i.e., cropping area 36a) of the image 
signal and digitally enlarges the extracted image area to 

25 the magnification indicated by the first zoom switch 115. 
In the example shown, 32 0 horizontal lines are extracted 
from the center of the second image area 32a, which has a 
vertical resolution of 480 horizontal lines, digitally 
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enlarges the extracted image area to an image with 480 
horizontal lines, and outputs the result to output image 
area 35a as the image signal enlarged 15X. 

A 320-line image can be enlarged to a 480-line 
5 image using a line interpolation process whereby signals 
for the non-existent lines are interpolated based on 
signal values in existing adjacent lines. The ultimately 
output image signal is therefore a 480-line image 
presented in output image area 35a, but the image 

10 resolution is equivalent to only 320 lines. 

An approximately 320-line image area is cropped 
from the second image area 32a in order to enlarge the 
image 15X in the above example. Because the vertical line 
count of the output image area 35a is fixed at 480 lines, 

15 however, the size of the cropping area 36a becomes smaller 
and the vertical line count decreases when the enlargement 
ratio is even higher. Therefore, as will also be known 
from curve A in Fig. 4, the vertical resolution drops as 
the zoom ratio increases. 

20 Operation when the second zoom switch 116 is 

operated is described next. 

When the user operates the second zoom switch 
116, the microprocessor 114 sets the selector switch 109 
to side a and activates the image trimming circuit 108. 

25 This causes the image quality processor 105 to output the 
processed image signal to the image trimming circuit 108 
for image cropping. This cropping operation is described 
below with reference to Fig. 2 (b) . 
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As described above, the image signal acquired 
through the lens unit 101, CCD 102, analog signal 
processor 103, A/D converter 104, and image quality 
processor 105 has a vertical line count of 720 lines as 
5 shown in first image area 31b in Fig. 2 (b) . This image 
signal is input to the image trimming circuit 108, which 
extracts the center 480 lines of the first image area 31b 
as shown in cropping area 34, thereby acquiring an image 
signal as shown in second image area 32b. As shown in the 

10 figure, the top and bottom of the subject 33 are cut off 
in the second image area 32b, and the subject image is 
relatively larger. Note that the vertical and horizontal 
line counts are not compressed in this cropping process. 
The area cropped in the horizontal direction is also 

15 determined automatically according to the vertical line 
count of the cropped image area so that the vertical and 
horizontal line counts of the final image are the same as 
those of the television format. The resulting image signal 
is then output to the image sizing circuit 110. 

20 If the first zoom switch 115 is not operated or 

is operated but the zoom ratio is within the optical zoom 
range (IX to 10X zoom ratio as shown in Fig. 3), the image 
sizing circuit 110 outputs the image without enlargement 
or reduction. 

25 In the optical zoom range from IX to 10X as 

shown in Fig. 3, the size of the image acquired when the 
second zoom switch 116 is operated is 1 . 5X the image size 
before the second zoom switch 116 was operated. In other 
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words, the relationship between zoom ratio and image size 
when the second zoom switch 116 is not operated is 
described by curve A in Fig. 3, but is described by curve 
B in Fig. 3 when the second zoom switch 116 is then 
5 operated. For example, if the zoom ratio is set to 10X and 
the second zoom switch 116 is then operated, the actual 
image size is enlarged from 10X to 15X. Furthermore, as 
shown in Fig. 4, in the optical zoom range from IX to 10X, 
the image enlarged by the lens unit 101 is cropped by the 
10 image trimming circuit 108 and there is no drop in 
resolution because there is no vertical and horizontal 
compression . 

Furthermore, because there is no line count 
compression by the vertical and horizontal image signal 

15 processing circuits 106 and 107 and the image cropped from 
the first cropping area 34 is output directly, response- 
that — isr time (i.e. , the time from when the second zoom 
switch 116 is operated to time of output of the enlarged 
image 7 — ) is significantly faster than when the first zoom 

20 switch 115 is operated to acquire an image enlarged 1.5 
times . 

Furthermore, if the zoom position when the 
second zoom switch 116 is operated is in the digital zoom 
| range of the first zoom switch 115 ( that io i.e. , set to a 
25 zoom ratio higher than 10X; see Fig. 3), or if the first 
zoom switch 115 is operated while zooming with the second 
zoom switch 116 and the zoom ratio enters the digital zoom 
range, the microprocessor 114 controls image sizing 
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circuit 110 to enlarge or reduce the image signal output 
from the image trimming circuit 108 accordingly. Referring 
to Fig. 2 (b) , the image sizing circuit 110 crops the 
image signal in second image area 32b acquired from the 
5 image trimming circuit 108 to the image shown in second 
cropping area 3 6b. 

The size of this second cropping area 36b varies 
according to the zoom ratio of the digital zoom. As the 
zoom ratio increases, the size of the second cropping area 

10 36b decreases. The image signal extracted from the second 
cropping area 36b is then enlarged to the vertical line 
count (720 lines) and horizontal line count (480 lines) of 
the television format, and an image signal as shown in 
output image area 35b is output. 

15 The relationship between zoom ratio and image 

size when using the second enlarging function in the 
digital zoom range is thus — as — shown and described with 
reference to Fig. 3. In this case zoom operation changes 
from curve A to curve B in Fig. 3, and an image 1.5 times 

20 larger than the image presented at the same zoom ratio on 
curve A is acquired. As shown by curve B in Fig. 4, there 
is also no drop in resolution at a zoom ratio from 10X to 
15X because the image enlarged by the optical zoom is 
enlarged 1 . 5X by the image trimming circuit 108. When the 

25 zoom ratio exceeds 15X, however, the actual zoom operation 
changes from the optical zoom to the digital zoom, and 
resolution therefore drops as the zoom ratio increases. 
This drop in resolution is less than when the second zoom 
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switch 116 is not used, however, — as indicated by curve A 
in Fig. 4 . At a zoom ratio of 20X, for example, curve A 
indicates a drop in the vertical resolution to 
approximately 0.5 times the native resolution, while curve 
B shows a drop to approximately 0.7 5 times the native 
resolution when the second zoom switch 116 is used. 

It will thus be apparent that when the second 
zoom switch 116 is used in this embodiment of the 
invention the image trimming circuit 108 crops the image 
to a defined area of the captured image without using 
compression, thereby improving the resolution of the 
output image while eliminating the time needed for image 
compression or other signal processing. As a result, an 
enlarged image can be immediately presented. 

Fig. 6 is a block diagram showing the internal 
configuration of the image trimming circuit 108 shown in 
Fig. 1 and further described below. 

Image signals from the image quality processor 
105 are input to input terminal 51. Image signals input to 
the input terminal 51 are stored to image memory 52, which 
could be frame memory or line memory but is preferably 
line memory due to cost considerations. Image signals read 
from the image memory 52 are output to the selector switch 
109 jrft — of Fig. 1 from the output terminal 53. Control 
signals from the microprocessor 114 are applied to control 
input terminal 54. Based on a control signal from the 
microprocessor 114, start point controller 56 sets the 
cropping area start point {^he — "-start point- 11 — below ) and 



outputs a start point signal. Likewise based on a control 
signal from the microprocessor 114, the end point 
controller 57 sets the cropping area end point (^fehe — -end 
point 11 — below ) and outputs an end point signal. Based on 
the start and end points from the start point controller 
56 and end point controller 57, the read controller 55 
controls reading images from the image memory 52. 

Operation of the image trimming circuit 108 thus 
comprised is described below. 

The start point and end pointo point are 

described first referring to Fig. 7. 

Fig. 7 corresponds to the image shown in Fig. (2- 

2 (b) with various line count values shown for easier 

understanding. Start point 61 and end point 62 are shown. 
The image trimming circuit 108 thus defines one corner 
point of a rectangular cropping area as the start point 61 
and sets the diagonally opposite corner point as the end 
point 62 on the photographed image. 

The start point 61 and end point 62 are each 
defined by the (x,y) coordinate values from the top left 
corner of the first image area 31b. More specifically, as 
shown in Fig. 7, the y-coordinate of the start point 61 of 
the cropping area 34 is the line count from the first 
horizontal line of the first image area 31b, and the x- 
coordinate is the line count (pixel count) from the left 
end of that line in the horizontal direction. In the 
example shown here the top 120 lines from the top 
horizontal line and the first 160 vertical lines (pixels) 



from the left edge are not needed. The starting point in 
the vertical direction- J_i.e., the y-coordinate of the 
start point 61 7 — ) is therefore line 121, and the starting 
point in the horizontal direction, i.e., the x-coordinate, 
5 is line (pixel) 161. 

The coordinates of the end point 62 of the 
cropping area 34 in Fig. 7 are similarly determined. More 
specifically, the y-coordinate of the end point 62 of the 
cropping area 34 is the line count from the first 

10 horizontal line of the first image area 31b, and the x- 
coordinate is the line count (pixel count) from the left 
end of that line in the horizontal direction. The end 
point in the vertical direction— J_i.e., the y- 
coordinate— ) is therefore line 600, and the end point in 

15 the horizontal direction, i.e., the x-coordinate, is line 
(pixel) 800 . 

It will be obvious that while the start and end 
points are both defined in this example, the end point 
could be calculated on-the-fly from the start point based 
20 on the 4:3 aspect ratio of the selected television format. 

The size of the cropped image signal read from 
the image memory 52 is therefore 480 horizontal lines by 
640 vertical lines. 

Operation of the image trimming circuit 108 is 
25 described more specifically below. 

When the second zoom switch 116 is operated, the 
microprocessor 114 sets the selector switch 109 to side a 
so that image signals from the image quality processor 105 
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are applied to the input terminal 51 of the image trimming 
circuit 108. Image signals input to the input terminal 51 
are written temporarily to image memory 52. 

When the second zoom switch 116 is operated, the 
control signal from the microprocessor 114 is also applied 
to the control input terminal 54. The control signal input 
to the control input terminal 54 contains a control signal 
for activating the image trimming circuit 108 as well as 
the start and end point values of the cropping area. 

The control signal applied to the control input 
terminal 54 is then applied to the start point controller 
56 and end point controller 57. The start point controller 
56 then generates a start point signal based on the value 
of the start point detected from the applied control 
signal. The end point controller 57 [56, — — likewise 
generates an end point signal based on the coordinates of 
the end point detected from the control signal. These 
start and end point signals are then input to the read 
controller 55. 

Based on the start point signal, the read 
controller 55 determines where to start cropping the image 
signal written to the image memory 52. Using a line 
counter not shown, the read controller 55 counts the 
vertical and horizontal line counts to locate the 
coordinates of the start point 61 in Fig. 7, that is, line 
121 vertically and line 161 horizontally. Based on the end 
point signal, the read controller 55 likewise determines 
the end point of the cropped image. Using a line counter^ 
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not shown, the read controller 55 counts the vertical and 
horizontal line counts to locate the coordinates of the 
end point 62 in Fig. 7, that is, line 600 vertically and 
line 800 horizontally. The limits of the first cropping 
5 area 34 are thus determined. 

Using the line counter, the read controller 55 
then counts the vertical and horizontal line counts of the 
image signal in the image memory 52. Reading starts when 
the start point 61 is detected and continues until the end 
10 point 62 is detected, thereby reading the image signal for 
the area shown as first cropping area 34. The image signal 
read from image memory 52 is output from output terminal 
53 and then output from side a of the selector switch 109 
shown in Fig. 1. 

15 The location of the first cropping area 34 can 

be desirably set as indicated by frames 34a and 34b in Fig. 
5 using an operating unit 117 such as cursor keys, for 
example, as shown in Fig. 8. Each time the operating unit 
117 is worked to set the cropping area, the microprocessor 

20 114 outputs the start and end points of the selected frame 
34a (see Fig. 5 (a)) to the image trimming circuit 108. 
Based on these start and end point values, the image 
trimming circuit 108 controls cropping the image to the 
part delineated by the defined frame 34a (see Fig. 5 (a)). 

25 If the operating unit 117 is operated again, the 

microprocessor 114 outputs the start and end points of the 
new frame 34b (see Fig. 5 (b) ) to the image trimming 
circuit 108. Based on these start and end point values, 
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the image triinming circuit 108 controls cropping the image 
to the part delineated by the new frame 34b (see Fig. 5 
(b) ) . 

The first cropping area 34 is assumed to be in 
5 the middle of the first image area 31b as shown in Fig. 2 
(b) in the embodiment described above. As will be apparent 
from Fig. 5, however, the cropping area 34 could be set to 
any desired area and is not limited to the middle of the 
image. As shown in Fig. 5 (a), for example, the cropping 

10 area could be an area 34a at the top left, or an area 34b 
at the bottom right, of the first image area 31b. The 
resulting cropped images are shown as 32c and 32d, 
respectively. The cropping area can be freely set using 
cursor keys to set the top left and bottom right corners, 

15 for example, or the cropping areas could be preprogrammed 
so that operating the second zoom switch 116 toggles 
between them. 

Owe — This invention can thus output an enlarged 
image with little to no image degradation, and the zooming 

20 effect can be accessed immediately by a simple switch 
operation. 

Although the present invention has been 
described in connection with the preferred embodiments 
thereof with reference to the accompanying drawings, it is 
25 to be noted that various changes and modifications will be 
apparent to those skilled in the art. Such changes and 
modifications are to be understood as included within the 
scope of the present invention as defined by the appended 
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claims, unless they depart therefrom. 
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ABSTRACT OF THE DISCLOSURE 



When an image signal processing circuit first 
compresses the an image and an image sizing circuit then 
enlarges the compressed image, the resolution, 
particularly the vertical resolution, is degraded by the 
enlarging process and overall image quality thus drops. 
This problem is solved by an image cropping circuit that 
crops tke — a photographed image to a defined image area 
without any image compression when a second zoom switch is 
engaged — operated . This improves the resolution of the 
output image and eliminates the time needed for image 
compression and other signal processing operations. An 
enlarged image can thus be easily and immediately 
presented for viewing . 
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